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The invention relates to a Finite Impulse Response W filter device for 
sample rate converting a sequence of discrete representations and to an image display device 
including such a filter device. P V 
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group of tapu, samp.es can be differ Such . fflter „ 
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To meet the objeet of the invention, the filter device includes- 
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summating element; the switching elements being arranged to enable supply a discrete 
representation from any tap point TPj to a summating element Si, where j <=i. 

Thearrangementofthetapsenablethefiltertoaccessmultipleelementsfrom 
^^-PUtpipelmeandmeoutputpipelmesimultaneously^ 

down-scaling or vice versa 

According to the measure of the dependent claim 2, each of the taps T { are 
coupled to only one respective summating elements Si ; the switching element S Wj being 

switching element may also be located in between the multipliers and the output pipeline 
This merely changes the respective multiplication coefficient out off the matrix Ci 

According to the measure of the dependent claim 3, the FIR filter device has a 
constantfilterwidth^^outputdelaycensDO.and^or^-l (depending on if the input 
^-^estaued)^^ 

beac^eved during downscaling, up-scaling, also when the scaling factor or scaling mode is 

According to the measure of the dependent claim 4, the input pipeline includes 
an mput switching network for accumulating input values in the input delay cells DI- 
enabling upscaling i„ situations where the input stream can not be temporarily halted while 
20 output samples are generated at a higher frequency. 

According to the measure of the dependent claim 5, each multiplier Mi is 
associated with a respective coefficient matrix Q to enable polyphase filtering. 

According to the measure of the dependent claim 6, the filter device includes a 

25 T T ratiVe t0 COntr01 ^ ^ ^ b3Sed ° n 3 State macW - * P<*ciple, many 
25 settings of the filter can be changed Using a state machine is an effective way to control the 
scaler settings. 

According to the measure of the dependent claim 7, the state machine 
determines at least one of the following: 

- a setting of the switching elements SWi, 

- a setting of the output switching network, 

- clocking of the input pipeline and/or output pipeline. 
Depending on the functionality of the filter, the state machine also determines 

a selection of a coefficient from the coefficient matrix C, and/or a setting of the input 
switching network. 
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According to the measure of the dependent claim 10, me filter device includes 
a further delay element and a subtracting element for subtracting an input discrete element 
from an unmediately preceding input discrete element and supplying an outcome of the 
subtraction into the input pipeline; and including a further summating element for adding the 
unmediately preceding input discrete element to an output discrete element to be supplied by 
the output pipeline, m this way the filter operates on 'AC values (i.e. on a difference with 
respect to the previous input sample instead of the absolute value). This avoids the so-called 
DC-npple. Such a ripple occurs where the input is more or less constant ('DC') and the 
coefficients applied to the filter do not exactly add up to a multiplication factor of 1 , causing 
a small disturbance being added. Where small sequences of constant values are interchanged 
wrth a different sample value this may result in a visible or in any other way noticeable 
«np P le' in the output signal for the filter. By operating on an offset instead of an absolute 
value, the filter is fed with zero-value samples for sequences of constant sample values. Such 
a sequence will result in a zero output of the multipliers, irrespective of small faults in-the 
multiplication factors. The actual input sample is added at the output of the filter. 

To meet an object of the invention, a signal processing apparatus includes a 
FIR filter device as claimed in claim 1 for sample rate converting an input signal, where the 
discrete representation is a sampled input signal, for subsequent rendering by a rendering 
device. ° 

These and other aspects of the invention are apparent from and will be 
elucidated with reference to the embodiments described hereinafter. 



In the drawings: 

Fig. 1 shows a prior art direct form FIR filter; 

Fig. 2 shows a prior art transposed form FIR filter; 

Fig. 3 shows upscaling using a direct form FIR filter; 

Fig. 4 shows downscaling using a transposed form FIR filter, 

Fig. 5 illustrates a FIR filter according to the invention; 

Fig. 6 shows a first embodiment of the filter; 

Fig. 7 shows a second embodiment of the filter; 

Fig. 8 shows a third embodiment of the filter; 

Fig. 9 shows a fourth embodiment of the filter; 

Fig. 10 shows more details of an embodiment of the filter; 
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the invention. 



Fig. 11 shows the way of indicating which samphs ^ ^ ^ ^ ^ 

Fig. 12 illustrates the states of a four-stage filter; 
Fig. 13 illustrates state transitions for state 2; 
Fig. 14 shows the states and transitions for a'four-stage filter- 
Fig. 15 shows the conditions for the transitions and the output- 
Ftg. 16 gives an example of a panorama processing of a sample line; and 
F.g. 1 7 shows a signal processing apparatus including the filter according to 
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switching for a variable scaling ratio (up- and downing). The filter la o-ptt (olock-) 
fixed number of multiplications per clock, wbieh is beneficial in Hardware (HW) Uaing «he 

-ouence often points Wl (in to fou , ^ ^ ^ ^ 

« P*>vtded a, leaa, between eaeb sequential pmr of input delay eella „ and D, M . Tie filter 
further ntcludes an caput pipehne OP witt, a sequence of output delay ceUs DO, each for 
aormg a discrete representation (sample) (shown am four otnpu, delay cells). In betiveen 
10 each se^entitd pair of otdpn, delay cells DO, and DO w is a summating elements s, for 

addntg two samples. The summating element S, receives one of m. smnp.es from a pteceding 
delay cell DO,, or an ompu, switehing network OSN for aceumulating oMpat vames from 
me summating elements. The output pipeline accumutetes multiplied inpur samples lor each 

be *>ded to a smgle orapu, sample (in a tmmner similar m when no new input sample is 
shtited mto the regular «, ter strocture) . ^ toput ^ ^ fc ^ 

vra sequence of N (FW) taps T„ Eaeb tap includes a respective mmtipher M, for multiplying a 
datcrete representation from an input tap point by a coefficient. A, teas,*-, of the taps 

emtbte supp,y of a discrete repmaentation from any tap point TP, to a summating Cement Si, 
where j <- t F.g. 5 shows tee awttching etemems SW„ SW„ and SW, Switching element 
SW.Kpart of tapT.andaUows an input samptetobe selected from teppointT, up ,„ and 

25 Zul ?' "* to *** «""" —* <*» « — ^ via 

25 TP1) and ,s, therefore, not shown. 

Fig. 6 shows a former embodimem, wherein me input pipeline IP includes a 
tnpu. swttehntg netiyorklSN for stiUltag ta p„, values ta me taput delay ceIb M , 
enables upscaling in situations where me input ^ can no, be temporarily baited while 
output samples are generated at a higher frequency. 

30 ■ „ L " lK emb< " ,taen,S Sh °™ ta ^ 5 »« «• «* ™*ching elemente are .ocated 

m betiveen mp„ tap ^ md rae muhipllera. In principte, me awitehing elements may 
also be located m betiveen the multiplies and me summating elements. This is Mustiated in 
tig. 7, which in other aspects corresponds to Fig. 6. 
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Fig. 8 shows an alternative embodiment where the switching elements SWi are 
integrated into a switching network (multiplexing layer, indicated as MUX) that may support 
more switching options than required. 

Fig. 9 shows a further embodiment including a delay element DI, and a 
subtracting element SUB. The current input sample and the immediately preceding input 
sample (supplied by the delay cell DI,) are subtracted from each other. The outcome of the 
subtract™ is fed into the input pipeline IP. In this way, the filter does not operate on 
absolute sample values but on relative sample values. In particular, if the input signal is 
constant for a certain sequence of input samples (a DC signal) the core filter will provide a 
'0' output In the embodiment of Fig. 9 the delayed input element is subtracted from the 
current input sample. An absolute input sample is added to the output of the output pipeline 
to g,ve the actual output sample, using a summating element S 0 . In Fig. 9, the input sample 
stored in delay element DI, is added to the output sample. In an alternative embodiment 
shown m Fig. 10 the current input sample is added to the output sample. It will be 
appreciated that in the embodiments of Figs. 9 and 10, the main purpose of DI, is to create a 
relative input signal. A further input delay element may be added to the input pipeline to 
complete the input switching network. This additional input delay element including 
feedback switch can be the same as shown for DI, to DI 4 of Fig. 6. It would be positioned 
after the input subtracter SUB and before the first tap T,. 

Fig. 10 provides more details of the filter as shown in Fig. 9 with the switching 
elements of Figs. 5 and 6. It shows that filter coefficients are supplied to the multipliers Mi 
Preferably, each multiplier Mi is associated with a respective coefficient matrix Q to enable 
poly-phase filtering For each filter phase, a different coefficient can be supplied to the 
multiplier for multiplication with an input sample. In itself, poly-phase filtering is known and 
25 will not be described further. 

In a preferred embodiment, the FIR filter device according to the invention 
includes a controller for controlling the filter device based on a state machine. The state 
machine may control any (preferably all) of the following aspects: 

- clocking of the input pipeline and/or output pipeline (via an input enable and output enable 
30 signal, respectively), 

- selection of a coefficient from the coefficient matrices Q, and/or 

- a setting of the switching elements SW,- (via a respective xsel; signal), 

- a setting of the output switching network OSN, 

- a setting of the input switching network ISN. 
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Fig. 10 also provides more details of the control of the filter. The main task of 
the state machine is to determine the multiplications that need to take place for each clock 
cycle. In this way, pipeline run-in and run-out effects are avoided. The state machine will be 
described in detail for a filter width of 4. Persons skilled in the art will be able to design a 
state machine for any desired filter width based on the same principles. The working of the 
state machine will be explained with reference to Figs. 1 1 to 16. Fig. 1 1 illustrates how in 
Fig. 12 it is indicated which samples are added to the output pipeline. As for Figs. 3 and 4, 
horizontally the input samples are shown and vertically the output samples. Fig. 1 1 shows' 
two cycles of the filter. In the first cycle, input sample m is added to the outputs n, n+1 and 
n+2, and input sample m-1 is added to output sample n+3. During the second cycle, input 
sample m+1 is added to output samples n+1 and n+2, and input sample m is added to output 
samples n+3 and n+4. 

Fig. 12 shows that the state machine has eight states for a filter width of 4. 
State 1 represents the normal transposed way, a single input sample is mapped onto FW 
output samples, corresponding to Fig. 5. State 8 represents the case wherein FW input 
samples are mapped onto FW output samples. Since the pipelined input and output samples 
have the restriction that they are consecutive, the number of possibilities can be 
mathematically computed. Each consecutive multiplication a multiplier operates on either the 
same input sample or the previous one (2 choices) and thus never ahead. The first multiplier 
does not have a choice; it always operates on the current input sample. Since FW equals four 
in this case there are 3 (FW minus one) multiplications which can be either one of the two 
choices given. This results in 2 to the power of 3 equals 8 possibilities. In general, for FW = „ 
a total of 2< FW -«> states are used. Thus, increasing FW results in an exponential increase of the 
number of possibilities (i.e. the number of distinct states). Referring the Fig. 5, this can also 
be illustrated as follows. Multiplier M, always receives the input from tap point TP, (no 
choice). Multiplier M 2 can selectively receive an input sample from TP 2 (i.e. the previous 
input sample) or TP, (i.e. the current input sample). So, two choices. In theory, multiplier Ma 
can selectively receive an input sample from TP 3 , TP 2 , or TP, . However, it is desired that the 
filter operates on a consecutive sequence of input samples, no 'holes' should occur (e.g. 
sample 1, 2, and 4 contribute to an output of the filter, but sample 3 was skipped). This 
implies that the choice of M 3 is limited to the sample preceding the one currently being 
selected for M 2 or the same one as being selected for M 2 . Similarly, M4 has a theoretic choice 
of four input samples, but is practically limited to the same one or the previous input sample 
(also two choices). 
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Since the cases are fixed for any predetermined FW it is most feasible to 
implement this in a finite state machine (FSM). Each state is followed either by itself or by 
another state so rules can be set up on state transitions. As will be described in more detail 
below, the transitions depend on the on forehand computed m low and m hlgh of the output 
samples. 

Fig. 13 illustrates the state transitions for state 2. In every state, like state 2 
three different transitions are possible (indicated as a, b and a). Transition a is done under the 
condition that the output sample is not finished (as will be described below: m hlgh has not 
been reached). In this case the state remains the same, a new input sample is requested no 
new output sample. Transitions t or c are done if m htgh has been reached, so not state a The 
deepen for b or c depends on m lm of the new output sample, m each of these two transition* 
apart from processing a new output sample also a new input sample is requested (this is not 
generally the case). Fig. 13 shows the current state (in this example state 2) as the left block 
The three other blocks show the state that is reached after transition «, b, or c, respectively 
For each block the state number is indicated in the upper left corner. So, Fig. 13 shows the 
following state transitions: 

a\2->2 

b: 2 -> 5, and 

c: 2 ->3. 

Using this notation no arcs need to be shown, although in Fig. 13 they are shown to illustrate 
the principle. Fig. 14 shows all transitions for all eight states. 

The state machine's output controls the scaling engine topology (which input 
samples contribute with which entry of the filter table to which output sample including the 
leanest of new input samples and shifting out ready computed output samples. Fig. 15 shows 
for each state the condition for any of the three possible state transitions, and the resulting 
output In this example, the state machine controls the switching elements S Wi via the 
respective signals xsel* (as also shown in Fig. 10), clocking the input pipe line, via signal 
input-enable i_en, and clocking of the output pipeline via signal output-enable o_en. 

Fig. 16 gives an example of a panorama processing of one sample line. The 
first input samples are upscaled. For successive sample, the ration is slowly adjustedto 11 ' 
followed by downscaling in the center. Then the reverse process occurs: the ration is again' 
slowly adjusted to 1:1, followed by upscaling. This process may be controlled by any suitable 
scaling curve, such as a parabola. 



10 



WO 2004/088842 



PCT/IB2004/050339 



10 



15 



20 



25 



30 



Each output sample receives a contribution from several input samples 
multiplied with a filter coefficient. The first sample to contribute is indicated with m, 
the last with mhlgh . All samples in between also contribute thus m low and m hlgh bounds the set 
of input samples for a specific output sample. As discussed before the distance between m low 
and m high needs not to be constant e.g., flexible (downscale) scaling ratio. The scaling ratio 
mus reflects itself on the distance of m tow and m hlgh with a given FW. 

Fig. 17 shows a signal processing apparatus 1700 that includes the FIR filter 
device 1 71 0 for sample rate converting an image signal, such as an audio or video signal. The 
discrete representations on which the filter operates are sampled input image signal, The 
-age signal may already be supplied in a suitable digital form to the display apparatus. If the 
signal 1S provided in an analogue form, the display apparatus may include an A/D converter 
for sampling the analogue signal. A controller 1720 is used for controlling the filter as 
described above. The controller 1720 may be embedded in the filter device or may be 
external to the filter device (e.g. being executed on suitable processor of the signal processing 
apparatus. The sample rate converted signal may be output for former processing by other 
apparatuses. In the latter case, the signal may be output in a suitable digital representation via 
a suitable digital interface. Such representations and interfaces are well known. It may also be 
converted to an analogue form using a D/A converter. The sample rate converted signal may 
be further processed by the signal processing apparatus itself. For example, the signal 
processing apparatus may include a storage device for storing the converted signal The 
storage may, for example, be a tape, hard disk, or solid state memory. The signal may be 
provided from the storage to a rendering device. The rendering device may be external or 
mternal to the signal processing apparatus. The rendering device may, for example, be a 
d 1S play device 1 730, such as a CRT, LCD, plasma display or a suitable other display, or an 
audio rendering device (amplifier 1740 and speakers 1750). 

It should be noted that the above-mentioned embodiments iUustrate rather than 
1»* the mvention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claim, In the claims, any 
reference signs placed between parentheses shall not be construed as limiting the claim. Use 
of the verb "comprise" and "include" and its conjugations do not exclude the presence of 
elements or steps other than those stated in a claim. The article "a" or "an" preceding an 
element does not exclude the presence of a plurality of such elements. The invention may be 
implemented by means of hardware comprising several distinct elements, and by means of a 
suitably programmed computer. A computer program product may be stored/distributed on a 
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suitable medium, such as optical storage, but may also be distributed in other forms, such a 
being distributed via the Internet or wired or wireless telecommunication systems. In a 
system/device/apparatus claim enumerating several means, several of these means may be 
embodied by one and the same item of hardware. The mere fact that certain measures are 
recited in mutually different dependent claims does not indicate that a combination of these 
measures cannot be used to advantage. 
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